https://vapi.ai/ logo
Join Discord
Powered by
Agent gibberish and hallucinizations
# support
k
There have been issues with the agents speaking in gibberish and hallucinating the past few days. Something is not functing properly because it has happened on multiple different topics. Is there an easy fix to this? I can give the call ids of calls where this has happened
v
Hi @KH, I'm an AI assistant for Vapi. I'll analyze available sources and get back to you shortly.
----------------------------- **While I generate an answer, here are some sources that might be helpful**: * [Prompting Guide]() * [Call Ended Reason]() * [Inbound Calling]() * [Introduction]() -----------------------------
### Answer It sounds like you're experiencing issues with agent responses that could potentially be attributed to several causes. Here are a few steps you can take to diagnose and potentially resolve this issue: 1. **Review the Assistant's Configuration**: Check the setup of your assistant, especially the system prompt or any specific configurations that may lead to unexpected behavior [(1)]() . 2. **Check the Language Model and Parameters**: Ensure that the language model (e.g., GPT-4) and parameters such as temperature or max tokens are set appropriately. Misconfiguration here can lead to unexpected or nonsensical responses from the assistant. 3. **Investigate Any Recent Changes**: If these issues have started occurring recently, review any changes made to the assistant's configuration or updates to the underlying model or services. 4. **Providing Call IDs**: If the issue persists, providing call IDs can help further diagnose the problem by looking into specific instances where the issue occurred [(2)]() . 5. **Consult Documentation and Community**: Sometimes, similar issues might have been encountered and documented by other users. Checking through the [documentation]() or community discussions might provide insights or solutions [(3)]() . If you've gone through these steps and the issue remains unresolved, it might be beneficial to examine the logs and specific configurations for the calls where this occurred. If you provide the call IDs, I can help look into this further.
g
Noticed this as well - Call ID: 50306092-617d-4b50-afaf-06b08fd9bf36
f
same - Call ID: aa711560-3dfe-4b52-81fb-1b0081f1056e
Call ID: 160171cd-502b-422c-8909-f00974ff4a63
u
I noticed this too, it opened with my set opener line followed by unrecognizable giberish "hey what's your name? " CallID: 1008386c-00b6-4ee9-b70b-00f2c2d2a2c9
f
it's across all GPT models and with and without detect emotion.
u
It might be tryingt o say
k
Some of my call IDs are
2fd83437-762a-4752-981b-6a9fc16cb6fb ; fa785c64-35f4-4836-871b-9a83d4cfc1bc
s
Can you please mention the audio time stamp and what should be the expected resposnse? @Gabriel C @KH @felly007 @.hardboiledfish
k
Just DMed you, thank you
f
What is everyone wordcount for the instructions give to an agent
u
right at the start, after the opening message
k
I have around 700 words in my prompt. Would shortening it help?
f
@KH potentially, I shorten mine and the gibberish took a bit longer to appear but I don't think it is the solution to our problem.
k
Yup, shortening my prompt did not help much. Thank you for the suggestion though
j
What voice are you guys using? Playht ? @felly007
f
@Jotham Deepgram Vapi GPT-4 Turbo Cluster 11labs Turbo V2.5 web
j
Are you using your own provider keys for anything?
f
no I'm not @Jotham
j
Hmm unsure. Are you using custom functions or knowledge base?
f
yes, I've got a calendar function but no knowledge base
k
I do not have functions, but have a knowledge base
s
One question, guys: are all of you using KnowledgeBase?
@KH issue was due to Knowledgebase can you please confirm me whether you guys are using KB or not @felly007 @.hardboiledfish @User
f
@Sahil how can I see if I am using KB?
I don't think I am
s
KB = Knowledge Base
f
yes I know that, but where is the tab for it?
u
Nope not using knowledge base
s
@felly007 just make sure no document is selected.
f
yes, I have no document selected
s
^ @.hardboiledfish
@felly007 ^
f
ID: 2e81d0a7-dcba-4549-9af0-4ab4c7d296e6 Timestamp: 22:17:28:216 Expected response: I can help with assisting you in booking an appointment.
It did reply that but continued with gibberish
any update?
s
You are using GPT-3.5, which is bad at function calling and sometimes says gibberish. In addition, your temperature is just too high. It is set to 2, but it should be 0.25. Lowering it will fix all of your issues, @felly007
If anyone of you still facing this issue please create a new ticket along with the latest call_id and time at which this issue occurred in the audio as well provide me the expected output.
g
Yep, I'm using KB w/ GPT4o. I had it happen again and hang up, but didn't have call recording turned on. I'll let you know if it happens again.
s
Okay.
f
seems like the issue is resolved. Thank you @Sahil 👍
3 Views
PreviousNext
Powered by